Occupation Times for Markov and Semi-Markov Chains

نویسندگان

چکیده

برای دانلود باید عضویت طلایی داشته باشید

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Stopped Markov chains with stationary occupation times

Let E be a nite set equipped with a group G of bijective transformations and suppose that X is an irreducible Markov chain on E that is equivariant under the action of G. In particular, if E = G with the corresponding transformations being left or right multiplication, then X is a random walk on G. We show that when X is started at a xed point there is a stopping time U such that the distributi...

متن کامل

Occupation Times for Markov-Modulated Brownian Motion

We determine the distributions of occupation times of a Markov-modulated Brownian motion (MMBM) in separate intervals before a first passage time or an exit from an interval. They will be derived in terms of their Laplace transforms, distinguishing occupation times in different phases too. For MMBMs with strictly positive variation parameters we further propose scale functions.

متن کامل

Markov Chains and Mixing Times

This paper introduces the idea of a Markov chain, a random process which is independent of all states but its current one. We analyse some basic properties of such processes, introduce the notion of a stationary distribution, and examine methods of bounding the time it takes to become close to such a distribution.

متن کامل

Markov chains and mixing times

For our purposes, a Markov chain is a (finite or countable) collection of states S and transition probabilities pij, where i, j ∈ S. We write P = [pij] for the matrix of transition probabilities. Elements of S can be interpreted as various possible states of whatever system we are interested in studying, and pij represents the probability that the system is in state j at time n+ 1, if it is sta...

متن کامل

Markov Chains and Mixing Times

Titles in this series are co-published with the Mathematical Sciences Research Institute (MSRI).

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

ژورنال

عنوان ژورنال: Transactions of the American Mathematical Society

سال: 1962

ISSN: 0002-9947

DOI: 10.2307/1993742